WE CLAIM: 



1 . An apparatus for routing at least one flow of packets over a network 
comprising: 

(a) a transceiver arranged to receive and forward each packet in a 
flow of packets; and 

(b) a processor, coupled to the transceiver, that is arranged to 
perform actions, including: 

(i) if at least one received packet in the flow of packets is 
associated with a traffic manager, forwarding the flow of packets to the associated 
traffic manager; and 

(ii) if each received packet in the flow of packets is 
unassociated with the traffic manager, performing actions, including: 

(A) selecting another traffic manager; and 

(B) associating the other traffic manager with the flow 
of packets, wherein each received packet in the flow of packets is forwarded to the other 
traffic manager. 

2. The apparatus of Claim 1 , further comprising a memory that is 
configured to store a connection key associated with at least one received packet in the 
flow of packets. 

3. The apparatus of claim 1, wherein the processor is arranged to perform 
actions, further comprising, if at least one received packet in the flow of packets 
includes at least one connection key associated with at least one traffic manager, storing 
each connection key and its association with each traffic manager. 

4. The apparatus of claim 3, wherein the connection key further comprises 
at least one of a source IP address, a destination IP address, a source port, virtual local 
area network (VLAN) identifier, and a destination port. 
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5 . The apparatus of claim 1 , wherein the processor is arranged to perform 
actions, further comprising: 

(a) receiving a signal from the traffic manager; and 

(b) if the signal indicates a memorize instruction, storing the 
connection key and an association with the other traffic manager. 

6. The apparatus of claim 1 , wherein the processor is arranged to perform 
actions, further comprising: 

(a) receiving a signal from the traffic manager; and 

(b) if the signal indicates a forget instruction, deleting the association 
between the connection key and the other traffic manager. 

7. The apparatus of claim 1 , wherein the processor is arranged to perform 
actions, further comprising, aging at least one connection key. 

8. The apparatus of claim 1, further comprising associating the other traffic 
manager with the connection key, and mirroring the connection key to another 
processor. 

9. The apparatus of claim 1 , wherein the processor includes at least one of a 
microprocessor, field-programmable gate arrays (FPGA), an application specific 
integrated chip, digital logic, and software. 

10. The apparatus of claim 1, wherein the apparatus is arranged to operate as 
at least one of a distributor, a router, a bridge, a firewall, and a gateway. 

1 1 . The apparatus of claim 1 , wherein each received packet includes at least 
one of a media access control address, a virtual local area network (VLAN) identifier, a 
transmission control protocol (TCP) port number, a user datagram protocol (UDP) port 
number, an internet protocol (IP) address, a physical port identifier, and a physical port. 
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12. A method for routing at least one flow of packets over a network 
comprising: 

(a) if at least one received packet in the flow of packets is associated 
with a traffic manager, forwarding the flow of packets to the associated traffic manager; 
and 

(b) if each received packet in the flow of packets is unassociated 
with the traffic manager, performing further actions, including: 

(i) selecting another traffic manager; and 

(ii) associating the other traffic manager with the flow of 
packets, wherein each received packet in the flow of packets is forwarded to the other 
traffic manager. 

13. The method of claim 12, further comprising sending a second signal to a 
second distributor, in response to detecting a communication protocol signal in packet 
seen by a first distributor, wherein the second signal instructs the second distributor to 
age a second association between a second flow of packets and the traffic manager. 

14. The method of claim 12, further comprising, in response to detecting a 
TCP FIN signal, aging the association between the flow of packets and the traffic 
manager. 

15. The method of claim 1 2, wherein associating the other traffic manager 
with the flow of packets further comprises storing a connection key and an identifier 
associated with the other traffic manager. 

16. The method of claim 12, wherein associating the other traffic manager 
with the flow of packets further comprises: 

(a) receiving the flow of packets from the other traffic manager; 

(b) determining whether a signal is associated with the received flow 

of packets; and 
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(c) if the signal indicates a memorize action, storing a connection 
key and an identifier associated with the other traffic manager. 

1 7. A system for routing at least one flow of packets over a network, 
comprising: 

(a) a plurality of servers; and 

(b) a distributor that is in communication with the plurality of 
servers, wherein the distributor is arranged to perform actions, including: 

(i) if a connection key in at least one received packet in the 
flow of packets is associated with a traffic manager, forwarding the flow of packets to 
the traffic manager associated with the connection key; and 

(i) if the connection key in each received packet in the flow 
of packets is unassociated with the traffic manager, performing actions, including: 

(A) selecting another traffic manager; and 

(B) associating the other traffic manager with the 
connection key, wherein each received packet in the flow of packets is forwarded to the 
other traffic manager. 

18. The system of Claim 1 7, wherein the distributor is arranged to perform 
further actions, including: 

(a) sending a signal to a second distributor, wherein the signal is 
indicative of the association between the flow of packets and the traffic manager; and 

(b) in response to detecting a communication protocol signal in 
another received packet in the flow of packets, sending a second signal to the second 
distributor, wherein the second signal is indicative of modifying the association between 
the flow of packets and the traffic manager. 

19. The system of claim 18, wherein modifying the association further 
comprises at least one of aging and deleting the association between the flow of packets 
and the traffic manager. 
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20. The system of claim 1 7, further comprising a plurality of traffic 
managers arranged to direct a flow of packets to at least one of the plurality of servers. 

2 1 . The system of claim 1 7, further comprising a plurality of traffic 
managers coupled to the transceiver, each traffic manager in the plurality of traffic 
managers is configured to perform actions, including: 

(a) receiving each packet in the forwarded flow of packets; 

(b) including a signal with each received packet, wherein the signal 
indicates at least one of a memorize instruction, and a forget instruction; and 

(c) forwarding each received packet including the signal to another 

processor. 

22. The system of claim 17, wherein selecting another traffic manager 
further comprises basing the selection in part on at least one of a round trip time (RTT), 
a least connections, a packet completion rate, a quality of service, a traffic management 
device packet rate, a topology, a global availability, a hop metric, a hash of an address 
in a received packet, a static ratio, a dynamic ratio, a source IP address, a destination IP 
address, a port number, and a round robin mechanism. 

23. A traffic manager for routing a flow of packets over a network, 
comprising: 

(a) a transceiver arranged to receive and to send each packet in the 
flow of packets; and 

(b) a transcoder, coupled to the transceiver, that is arranged to 
perform actions, including: 

(i) receiving each packet in the flow of packets from a client 
through a first distributor; 

(ii) associating a memorize signal with at least one received 
packet in the flow of packets; and 

(iii) forwarding each received packet including the signal to a 

second distributor, wherein the second distributor is configured to store a connection 
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key and an identifier associated with the traffic manager in response to the received 
memorize signal. 

24. The traffic manager of claim 23, further comprising, sending the 
memorize signal corresponding to the flow of packets to at least two distributors. 

25. The traffic manager of claim 23, wherein the first distributor and the 
second distributor are the same distributor. 

26. A method for routing two related flows of packets, including a first flow 
and a second flow, over a network having a plurality of traffic managers, comprising: 

(a) receiving the first flow of packets in the related flows of packets; 

(b) receiving the second flow of packets in the related flows of 

packets; 

(c) forwarding the first flow of packets to a target traffic manager 
selected from the plurality of traffic managers, wherein the target traffic manager is 
selected based in part on a first connection key; and 

(d) forwarding the second flow of packets to the target traffic 
manager based in part on the second connection key. 

27. The method of claim 26, wherein the first flow of packets and second 
flow of packets further comprise a bi-directional flow of packets wherein the first flow 
of packets flow in one direction and the second flow of packets flow in a different 
direction. 

28. The method of claim 26, wherein the first flow of packets is a control 
flow and the second flow of packets is a data flow. 

29. The method of claim 26, further comprising: 

(a) storing an association between the first flow of packets in the 
related flows of packets and the target traffic manager; and 
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(b) in response to receiving the second flow of packets in the related 
flows of packets, employing the association to identify the target traffic manager storing 
an association between the second flow of packets and the target traffic manager. 



30. The method of claim 26, further comprising: 

(a) receiving a packet in the first flow of packets from the target 
traffic manager; 

(b) determining whether a signal is associated with the received 
packet in the first flow of packets; and 

(c) if the signal is a memorize signal, storing the first connection key 
and an identifier associated with the target traffic manager. 

3 1 . The method of claim 26, further comprising: 

(a) receiving a packet in the first flow of packets from the target 
traffic manager; and 

(b) in response to the received packet, storing the first connection 
key and an identifier associated with the target traffic manager. 

32. An apparatus for routing a flow of packets over a network, comprising: 

(a) a means for receiving and forwarding at least one packet in the 
flow of packets; and 

(b) a means for forwarding each received packet in the flow of 
packets to a traffic manager, wherein the forwarding means determines the traffic 
manager based in part on a connection key that is associated with the flow of packets 
such that each forwarded packet in the flow of packets is routed to the same traffic 
manager. 

33. A method for routing a flow of packets over a network, comprising: 
(a) transmitting a signal, from a traffic manager to a distributor, 

wherein the signal indicates a processing instruction associated with the flow of 
packets; 
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(b) receiving the signal at the distributor; 

(c) receiving, at the distributor, a packet in the flow of packets; and 

(d) processing, at the distributor, the packet based at least in part on 

the signal. 

34. The method of Claim 33, wherein receiving the signal at the distributor 
further comprises storing a mapping between the flow of packets and the traffic 
manager. 

35. The method of Claim 33, wherein processing the packet further 
comprises forwarding the packet to the traffic manager. 

36. A method for routing a flow of packets over a network, comprising: 

(a) receiving, from a target traffic manager, a signal representing a 
processing instruction associated with the flow of packets; 

(b) receiving, a packet in the flow of packets; and 

(c) processing the packet based at least in part on the signal 
representing the processing instruction. 

37. The method of Claim 36, further comprising, in response to receiving the 
signal, storing a mapping between the flow of packets and the target traffic manager. 

38. The method of Claim 36, further comprising: 

(a) in response to receiving the signal, storing a mapping between 
the flow of packets and the target traffic manager; 

(b) receiving from the target traffic manager, another signal 
associated with the flow of packets, wherein the other signal represents another 
processing instruction associated with the flow of packets; and 

(c) in response to receiving the other signal, deleting the mapping 
between the flow of packets and the target traffic manager. 



36 



39. The method of Claim 36, wherein processing the packet further 
comprises forwarding the packet to the target traffic manager. 

40. The method of Claim 36, wherein receiving the signal further comprises 
receiving, from the target traffic manager, the signal together with another packet. 

41 . The method of Claim 36, wherein receiving the packet further comprises 
receiving the packet from a client device, and wherein receiving the signal further 
comprises receiving the signal together with another packet addressed to the client 
device. 

42. The method of Claim 36, further comprising in response to receiving the 
signal, sending the processing instruction to a distributor. 

43 . An apparatus for routing at least one flow of packets over a network 
comprising: 

(a) a transceiver arranged to receive and forward each packet in a 
flow of packets; and 

(b) a processor, coupled to the transceiver, that is arranged to 
perform actions, comprising: 

(c) receiving, from a distributor, a packet in the flow of packets; and 

(d) sending to the distributor, a signal representing a processing 
instruction associated with the flow of packets. 

44. The apparatus of Claim 43, wherein the processing instruction further 
comprises at least one of a memorize instruction, a mirroring instruction, and a delete 
instruction. 

45. The apparatus of Claim 43, wherein sending the signal further comprises 
sending the signal together with the packet received from the distributor. 
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46. The apparatus of Claim 43, wherein sending the signal further comprises 
sending the signal together with a second packet in the flow of packets. 

47. An apparatus for routing a plurality of packet flows over a network 
comprising: 

(a) a transceiver arranged to receive and forward each packet in the 
plurality of packet flows; 

(b) an interface, coupled to the transceiver, and arranged to perform 
actions, including: 

(i) receiving an instruction; 

(ii) if the instruction is a memorize instruction, storing a 
mapping between a designated packet flow in the plurality of packet flows and a target 
network device; and 

(iii) if the instruction is a delete instruction, deleting the 
mapping between the designated packet flow in the plurality of packet flows and the 
target network device. 

48. The apparatus of Claim 47, wherein the interface is arranged to perform 
further actions, including, if the instruction is a mirror instruction, mirroring the 
mapping between the designated packet flow and the target network device. 

49. A method of routing at least two flows, comprising: 

(a) determining at a traffic manager if the at least two flows are 
related, and if the at least two flows are related, 

(i) transmitting a signal, from the traffic manager to a 
distributor, indicating that the at least two flows are related; 

(ii) storing, at the distributor, a mapping of the at least two 
flows and the traffic manager; and 

(b) receiving, at the distributor, a packet from at least one flow; and 

(c) forwarding the packet from the at least one flow from the 

distributor to the traffic manager based in part on the mapping. 
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50. The method of claim 49, wherein receiving the packet further comprises: 

(a) extracting a first connection key from the packet; and 

(b) determining if the packet is associated with the traffic manager 
based in part on the mapping, and if the packet is unassociated with the traffic manager, 
extracting a second connection key from the packet. 

5 1 . The method of claim 50, wherein the second connection key further 
comprises a subset of fields included within the first connection key. 

52. A method for routing a first flow of packets and a second flow of packets 
that is related to the first flow of packets, over a network comprising: 

(a) associating the first flow of packets with a traffic manager; 

(b) associating the second flow of packets with the traffic manager; 

and 

(c) in response to detecting a signal in the first flow of packets, aging 
the association between the second flow of packets and the traffic manager. 

53. The method of claim 52, wherein the signal further comprises a TCP 
protocol signal. 

54. The method of claim 52, wherein the signal further comprises a TCP 

FIN. 

55. The method of claim 52, further comprising: 

(a) storing a sequence number corresponding to the first flow of 

packets; and 

(b) employing the sequence number to determine whether the signal 
is a valid FIN signal. 
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56. The method of claim 52, further comprising, in response to detecting the 
signal, in a first distributor, sending a second signal to a second distributor, wherein the 
second signal instructs the second distributor to age the second flow of packets. 
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